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DIFFERENT FOCAL LENGTHS 

Background 

This invention relates generally to digital imaging 
including digital imaging associated with digital cameras 
and devices that utilize digital imaging technology 
including digital microscopes. 

Conventionally, a single imaging device may focus on 
one object in its field of view. In many cases, the user 
can adjust the focus to bring an object at a particular 
focal distance into sharp focus in the resulting image. 

Often times, items of interest may be at different 
distances from the digital imaging device. It is generally 
not possible to capture an in- focus image of objects at 
different focal lengths. 

As a result, when objects are at different focal 
lengths from the imaging device, some of the objects may be 
in focus while other objects may be out of focus. The user 
can control which object is in focus by controlling the 
focal length of the imaging device. However, it would be 
desirable to enable objects at different focal lengths from 
the imaging device to be captured in focus . 
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Brief Description of the Drawings 
Figure 1 is a schematic depiction of one embodiment of 
the present invention; 

Figure 2 is a flow chart for software in accordance 
5 with one embodiment of the present invention; and 

Figure 3 is a depiction of hardware in accordance with 
one embodiment of the present invention. 

Detailed Description 
Referring to Figure 1, a digital imaging device 3 6 

10 such as a camera may be at different distances from two 
objects A and B to be captured in the resulting digital 
image. For example, the object A may be at a focal length 
A from the imaging device 36 and the object B may be at a 
focal length B from the imaging device 36. As a result, a 

15 single imaging device 3 6 may be unable to capture images of 
both objects A and B that are completely in focus. 
Instead, the user may adjust the focus on the imaging 
device 3 6 to place one of the objects A or B in focus. The 
other object, which is not placed in focus, then appears 

20 somewhat blurred in the resulting captured image. 

In accordance with one embodiment of the present 
invention, the imaging device 3 6 may be focused over at 
least two different focal lengths so as to capture both 
objects A and B in focus. The images of the objects A and 

25 B may then be combined to create a composite image in which 
both objects are in proper focus. In some embodiments, the 
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imaging device 36 may automatically scan through a number 
of focal lengths resulting in an image with objects in 
focus at multiple focal lengths. In other embodiments, the 
imaging device 3 6 may be manually focused at any number of 
different focal lengths by the user. 

Turning to Figure 2, in accordance with one embodiment 
of the present invention, the flow 10 may be implemented by 
software or hardware. Initially, the imaging device 36 
captures a current frame. The flow 10 cycles through each 
current frame and updates an existing reference frame that 
contains the accumulated image information from previous 
frames, as indicated in block 12. The current frame is 
then transformed to be a scalar, rotational, and 
translational equivalent of the reference frame, as 
indicated in block 14. Thus, images from different focal 
planes may be correlated despite the difference in focal 
lengths. The current frame may need to be adjusted in 
terms of its size, brightness, keystoning, color, contrast 
and orientation for example, to be consistent with the 
reference frame. 

The current and reference frames may have different 
focal lengths. A variety of images of different focal 
lengths may be captured either from manual focusing through 
different focal lengths, or by an automated process wherein 
a digital imaging device 3 6 automatically scans through 
different focal lengths. 



The transformed current frame is then analyzed to 
determine its sharpness on a pixel -by-pixel basis in one 
embodiment. The sharpness information may be stored in the 
alpha channel, as indicated in block 16. The alpha channel 
is a channel separate from the channels that contain red, 
blue and green (or other color space) information. The 
alpha channel information may specify the sharpness on a 
sliding reference scale, for example, by assigning a 
sharpness value of from 0 to 255. 

Using the alpha values, the current frame is then 
compared with the reference frame, as indicated in block 
18. The reference frame is then updated based on the 
relative alpha values of the reference and current frames. 
This updated reference frame now contains an image with an 
increased depth of field. The reference frame can now be 
displayed to the end user, or stored to some medium as an 
entirely focused image. The reference frame may also 
include historical data to ensure that stale data expires. 
In one embodiment, a stream of live video images is fed 
into the algorithm. This live feed gradually refines the 
accuracy of the reference frame. 

Generally, the higher the sharpness value the more a 
pixel is weighted in the resulting adjusted reference 
frame. Thus, pixels from either a current or reference 
frame are weighted more heavily the better their focus. 



The updated reference frame may then be displayed as 
indicated in block 20. 

In some embodiments, the algorithm indicated in Figure 
2 may occur in a real time basis. In other embodiments, a 
5 non-real time solution may also be readily accomplished. 

In this way in- focus pixels are weighted more heavily 
in generating the updated reference frame. As a result, 
image portions that are in focus, taken at different focal 
lengths, are effectively added on to the reference frame. 
10 Pixels with alpha values indicating poorer focus are 

dominated by pixels having better focus indicating alpha 
values . 

If the imaging device 36 is moved during focusing, a 
stitching or mosaicing algorithm can be used to compensate 
15 for movement. Also, a heavily modified background 

segmentation algorithm may be used to aid in constructing 
i ma g es that include objects that are actually moving. 

Referring to Figure 3, a processor-based system 22 may 
include a processor 24 coupled to a bridge 30. The bridge 
2 0 3 0 may be coupled to a memory controller 26 and a memory 
28 . 

The bridge 30, in some embodiments, may also be 
coupled to a bus 32. The bus 32 may be coupled via an 
interface 34 to the digital camera or other imaging device 
25 36. The bus 32 may also be coupled to a bridge 38, which 
couples to a hard disk drive 40 that stores software 10. 
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The bridge 3 8 may also be coupled to a legacy bus 42 in 
some embodiments. 

In some embodiments, images having in- focus objects at 
different focal lengths may be constructed without using a 
priori data such as actual focal length information as 
actual focal length information or other directly obtained 
lens characteristics. In some embodiments, an iterative 
approach simplifies the image generation algorithm. 

While the architecture depicted in Figure 3 is for 
purposes of an example only, the present invention is 
applicable to a wide range of different architectures of 
processor-based systems. The processor-based system 22 may 
be a camera, a microscope, or any other imaging device. 
Likewise, the system 22 may include a personal computer 
coupled to a digital imaging device such as a camera in 
other embodiments. 

While an embodiment is described with at least two 
different focal lengths, in some embodiments, images at any 
number of different focal lengths may be captured and 
particularly focused. 

While the present invention has been described with 
respect to a limited number of embodiments, those skilled 
in the art will appreciate numerous modifications and 
variations therefrom. It is intended that the appended 
claims cover all such modifications and variations as fall 
within the true spirit and scope of this present invention. 



What is claimed is: 
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